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Abstract 
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stability  for  nonlinear  continuous  and  hybrid  systems.  We  prove  that  bounded  versions  of  the 
5-stability  problems  are  generally  decidable,  and  give  upper  bounds  on  their  complexity.  The  un¬ 
bounded  versions  are  generally  undecidable,  for  which  we  measure  their  degrees  of  unsolvability. 
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1  Introduction 


Stability  of  dynamical  systems  is  a  central  topic  in  control  theory.  The  computational  nature  of 
stability  properties  has  been  a  topic  of  much  recent  investigation  [3,  5,  6,  1,  13,  2].  A  focus  of 
existing  work  is  to  establish  various  hardness  results,  i.e.,  lower  bounds  on  complexity.  It  is  shown 
that  stability  of  simple  systems  is  hard  or  impossible  to  solve  algorithmically.  Such  results  are 
proved  by  reducing  combinatorial  problems  over  graphs  or  matrices  to  stability  problems,  which 
can  be  analyzed  with  techniques  of  standard  complexity  theory.  A  limitation  is  that  reduction 
techniques  are  usually  not  suitable  for  establishing  upper  bounds  on  complexity,  and  indeed  most 
questions  about  upper  bounds  are  open  [1]. 

Note  that  the  existing  approaches  measure  complexity  of  stability  through  symbolic  manipu¬ 
lation  of  their  descriptions.  While  doing  so  is  suitable  for  establishing  hardness  results  (for  sub¬ 
classes  of  the  systems),  it  is  at  the  core  different  from  the  practice  in  control  theory,  which  is  mostly 
based  on  numerical  computations  over  real  numbers.  We  argue  that  more  general  results  for  com¬ 
plexity  of  stability  need  to  take  into  account  of  how  real  numbers  and  real  functions  are  computed, 
as  studied  in  computable  analysis  [14,  12,  8].  However,  while  complexity  for  real  functions  is 
best  measured  in  the  model  of  Type  2  Turing  machines  [12],  stability  problems  are  still  standard 
decision  problems  that  should  be  measured  in  the  standard  complexity  classes.  Moreover,  it  is  im¬ 
portant  to  distinguish  the  difficulty  with  manipulating  real  numbers  from  the  intrinsic  complexity 
of  control  problems.  For  instance,  if  a  real  number  x  is  represented  numerically  (as  an  infinite 
Cauchy  sequence  of  rationals),  determining  whether  ’A  =  0”  is  already  undecidable  [14].  Using 
such  hardness  in  measuring  complexity  of  practical  control  problems  would  be  misleading,  be¬ 
cause  in  practice,  the  problems  are  always  solved  up  to  some  nonzero  error  bound.  That  is,  |.r|  <  d 
for  a  sufficiently  small  d  is  what  we  need  in  practice,  rather  than  the  theoretically  undecidable 
equality  testing.  The  computational  nature  of  the  problem  is  very  different  with  such  a  relaxation. 

We  will  show  that  5-decisions  over  the  real  numbers  [10,  9]  provides  a  suitable  framework 
for  measuring  the  intrinsic  complexity  of  control  problems  to  address  the  issues  discussed  above. 
Within  this  framework,  we  can  study  the  following  version  of  stability  problems.  Given  a  dynam¬ 
ical  system  and  an  arbitrarily  small  5  G  Q+,  we  ask  for  one  of  the  following  answers: 

•  The  system  is  stable. 

•  The  system  is  unstable  under  numerical  perturbations  bounded  by  5. 

We  call  this  the  5 -stability  problem.  With  this  definition,  we  are  able  to  give  precise  upper  bounds 
for  the  “practical  complexity”  of  stability  problems  for  a  wide  range  of  continuous  and  hybrid 
systems.  We  are  able  to  prove  results  of  the  following  type: 

•  Bounded  Lyapunov  5-stability  resides  in  the  complexity  class  (H^)^,  where  C  is  the  com¬ 
plexity  of  continuous  functions  in  the  system,  (fig  denotes  the  complexity  class  in  the  poly¬ 
nomial  hierarchy). 

•  Bounded  asymptotic  5-stability  resides  in  the  complexity  class  (^I^)*". 

•  Unbounded  Lyapunov  5-stability  is  undecidable,  whose  degree  of  undecidability  is  fl®.  Un¬ 
bounded  asymptotic  5-stability  is  undecidable,  whose  degree  of  undecidability  is  in 
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•  Lyapunov  methods  reduce  problems  into  lower  complexity  classes  such  as  (512)'“. 

We  believe  these  results  are  the  first  general  characterization  of  the  complexity  of  stability.  More¬ 
over,  the  importance  of  the  results  is  not  just  theoretical.  The  past  decade  has  seen  great  advance¬ 
ment  in  decision  procedures  (SAT,  QBF,  and  SMT  solvers)  that  can  handle  many  large  instances 
of  NP-hard  problems.  The  complexity  analysis  shows  the  possibility  of  developing  generic  algo¬ 
rithmic  approaches  to  control  problems  of  nonlinear  and  hybrid  systems. 

In  all,  the  main  contributions  of  the  paper  are  as  follows: 

•  We  define  a  framework  for  measuring  the  “practical  complexity”  of  stability  problems  for 
a  wide  range  of  nonlinear  continuous  and  hybrid  systems.  To  do  so,  we  describe  stability 
properties  of  systems  as  first-order  formulas  over  the  real  numbers,  and  reduce  stability 
problems  to  the  5-decision  problems  of  these  formulas. 

•  The  framework  allows  us  to  obtain  a  precise  characterization  of  the  complexity  of  different 
notions  of  stability  that  has  not  been  discovered  previously.  We  prove  that  bounded  version 
of  the  stability  problems  are  generally  decidable,  and  give  upper  bounds  on  their  complexity. 
The  unbounded  versions  are  generally  undecidable,  for  which  we  measure  their  degrees  of 
unsolvability. 

The  paper  is  organized  as  follows.  In  Section  II,  we  review  definitions  of  complexity  classes  and 
some  main  results  from  computable  analysis.  In  Section  III,  we  review  the  theory  of  5-decisions 
over  the  reals  and  introduce  the  logic  language  that  can  encode  a  wide  range  of  dynamical  systems 
and  properties.  In  Section  IV,  we  study  the  complexity  of  stability  of  continuous  systems.  In 
Section  V,  we  study  the  same  questions  for  hybrid  systems.  We  conclude  in  Section  VI  and  suggest 
future  directions. 


2  Preliminaries 

2.1  Oracle  Machines,  Polynomial  and  Arithmetic  Hierarchies 

We  review  the  basic  definitions  for  complexity  hierarchies. 

A  (set-)  oracle  Turing  machine  M  extends  an  ordinary  Turing  machine  with  a  special  read/write 
tape  called  the  oracle  tape,  and  three  special  states  qquery,  qyes,  qno-  To  execute  M,  we  specify  an 
oracle  language  O  C  {0, 1}*  in  addition  to  the  input  ;c.  Whenever  M  enters  the  state  qquery,  it 
queries  the  oracle  O  with  the  string  s  on  the  oracle  tape.  If  5  G  O,  then  M  enters  the  state  qyes, 
otherwise  it  enters  qno-  Regardless  of  the  choice  of  O,  a  membership  query  to  O  counts  only  as  a 
single  computation  step.  A  function-oracle  Turing  machine  is  defined  similarly  except  that  when 
the  machine  enters  the  query  state  the  oracle  (given  by  a  function  /  :  {0,1}*  — )■  {0,1}*)  will  erase 
the  string  5  on  the  query  tape  and  write  down  f{s).  Note  that  such  a  machine  must  take  |/(5)  |  steps 
to  read  the  output  from  the  query  tape.  We  write  M^(x)  (resp.  (jc))  to  denote  the  output  of  M 
on  input  jc  with  oracle  O  (resp.  /). 
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The  polynomial  hierarchy  PH  is  a  hierarchy  of  complexity  classes  that  is  defined  through  oracle 
computation.  The  base  case  are  the  well-known  complexity  classes  P  and  NP.  The  classes  in  the 
hierarchy  are  recursively  defined  in  the  standard  way: 

zE  =  nE  =  p.zE+i(A)  =  NP^^'f^EnE+iiA)  =  conp^^"*** 

It  is  well-known  that  PH  C  PSPACE.  If  P  7^  NP,  then  each  class  in  the  hierarchy  contains  harder 
problems  than  the  previous  ones.  For  undecidable  problems,  there  exists  an  analogous  arithmetic 
hierarchy.  The  base  case  is  Z®,  which  is  the  class  of  the  halting  problem.  The  other  classes  in  the 
arithmetic  hierarchy  Hg,  Z2, ...  alternate  in  a  similar  way.  The  detailed  definitions  of  polynomial 
and  arithmetic  hierarchy  can  be  found  in  standard  textbooks  on  recursion  theory  and  computational 
complexity  such  as  [4]. 

2.2  Type  2  Computable  Functions 

Given  a  finite  alphabet  E,  let  E*  denote  the  set  of  finite  strings  and  E“  the  set  of  infinite  strings 
generated  by  E.  For  any  51,52  G  E*,  (51,52)  denotes  their  concatenation.  An  integer  i  G  Z  used  as 
a  string  over  {0, 1}  has  its  conventional  binary  representation.  The  set  of  dyadic  rational  numbers 
is  D  =  {m/2”  :  m  G  1j,n  G  N}. 

Computations  over  Infinite  Strings  Standard  computability  theory  studies  operations  over  fi¬ 
nite  strings  and  does  not  consider  real- valued  functions.  Real  numbers  can  be  encoded  as  infinite 
strings,  and  a  theory  of  computability  of  real  functions  can  be  developed  with  oracle  machines 
that  perform  operations  using  function-oracles  encoding  real  numbers.  This  is  the  approach  devel¬ 
oped  in  Computable  Analysis,  a.k.a..  Type  2  Computability.  We  will  briefly  review  definitions  and 
results  of  importance  to  us.  Details  can  be  found  in  the  standard  references  [14,  12,  7]. 

Definition  2.1  (Names).  A  name  of  a  G  M  is  defined  as  a  function  7^  :  N  — )■  D  satisfying 

V/GN,|r«(/)-a|<2-k 


Forde  M”,  Ya{i)  =  (rfli(0,-,rfl„(0)- 

Thus  the  name  of  a  real  number  is  a  sequence  of  dyadic  rational  numbers  converging  to  it.  For 
a  G  M”,  we  write  r(a)  =  {7 :  yis  a  name  of  a}.  Noting  that  names  are  discrete  functions,  we  can 
define 

Definition  2.2  (Computable  Reals).  A  real  number  a  G  M  A  computable  if  it  has  a  name  Ja  that  is 
a  computable  function. 

A  real  function  /  is  computable  if  there  is  a  function-oracle  Turing  machine  that  can  take  any 
argument  a:  of  /  as  a  function  oracle,  and  output  the  value  of  f{x)  up  to  an  arbitrary  precision. 
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Definition  2.3  (Computable  Functions).  We  say  a  real  function  /  :C  M"  — )■  M  Type  2  computable 
if  there  exists  a  function-oracle  Turing  machine  My,  outputting  dyadic  rationals,  such  that  for  any 

X  G  dom(/),  any  name  y^forx,  and  any  i  G  N,  the  output  ofM^^^^  satisfies  that 

\Mfii)-fix)\<2-\ 

which  means  that  it  approximates  fix)  up  to 

In  the  definition,  i  specifies  the  desired  error  bound  on  the  output  of  My  with  respect  to  fix). 
For  any  x  G  dom(/),  My  has  access  to  an  oracle  encoding  the  name  of  x,  and  output  a  2^'- 
approximation  of  fix).  In  other  words,  the  sequence 

is  a  name  of  fix) .  Intuitively,  /  is  computable  if  an  arbitrarily  good  approximation  of  fix)  can  be 
obtained  using  any  good  enough  approximation  to  any  ^  G  dom(/). 

Proposition  2.4  ( [14]).  The  following  real  functions  are  computable:  addition,  multiplication,  ab¬ 
solute  value,  min,  max,  exp,  sin  and  solutions  of  Lipschitz-continuous  ordinary  differential  equa¬ 
tions.  Compositions  of  computable  functions  are  computable. 

A  key  property  of  the  above  notion  of  computability  is  that  computable  functions  over  reals 
must  be  continuous.  In  fact,  over  any  compact  set  D  C  M",  computable  functions  are  uniform 
continuous  with  a  computable  modulus  of  continuity.  Intuitively,  if  a  function  has  a  computable 
uniform  modulus  of  continuity,  then  fixing  any  desired  error  bound  2^'  on  the  output,  we  can 
compute  a  global  precision  2^'”/^')  on  the  inputs  from  D  such  that  using  any  2^'"/*^')-approximation 
of  any  x  G  D,  fix)  can  be  computed  within  the  error  bound. 

Complexity  of  real  functions  is  usually  defined  over  compact  domains.  Without  loss  of  gen¬ 
erality,  we  consider  functions  over  [0, 1].  Intuitively,  a  real  function  /  :  [0, 1]  — )■  M  is  (uniformly) 
P-computable  (PSPACE-computable),  if  it  is  computable  by  an  oracle  Turing  machine  My  that 
halts  in  polynomial-time  (polynomial-space)  for  every  i  G  N  and  every  x  G  dom(/).  The  formal 
definition  is  as  follows: 

Definition  2.5  ([12]).  A  real  Junction  f  :  [0, 1]"  — )■  M  is  in  Pc[o,i]  i^^sp.  PSPACEc|o  ij)  iff  there 
exists  a  representation  (my,  Oy)  of  f  such  that 

•  my  is  a  polynomial  function,  and 

•  for  any  J  G  (D  fl  [0, 1])”,  e  G  D,  and  i  G  N,  Oyidfi)  is  computable  in  time  (resp.  space) 
OiJlenid)  -\-  i)^)  for  some  constant  k. 

Proposition  2.6.  The  following  real  functions  all  reside  in  Type  2  complexity  class  Pc[o,i]-'  absolute 
value,  polynomials,  binary  max  and  min,  exp,  sin,  and  their  bounded  compositions. 

It  is  shown  that  solutions  of  Lipschitz-continuous  differential  equations  are  computable  in 
PSPACEc[o,i]-  III  it  is  shown  to  be  PS  PACE-complete  in  the  following  sense. 

Proposition  2.7  ([11]).  Let  g  :  [0, 1]  X  M  — )■  M  (ze  polynomial-time  computable  and  consider  the 
initial  value  problem  =  g{t,f{t))  for  f(0)  =  0  and  t  G  [0, 1].  Then  computing  the  solution 
/  :  [0, 1]  — )■  M  is  in  PSPACE.  Moreover,  there  exists  g  such  that  computing  f  is  PSP  ACE-complete. 
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3  -Formulas  and  5 -Decidability 

3.1  -Formulas 

We  will  use  a  logical  language  over  the  real  numbers  that  allows  arbitrary  computable  real  func¬ 
tions  [14].  We  write  to  represent  this  language.  Intuitively,  a  real  function  is  computable  if 
it  can  be  numerically  simulated  up  to  an  arbitrary  precision.  For  the  purpose  of  this  paper,  it  suf¬ 
fices  to  know  that  almost  all  the  functions  that  are  needed  in  describing  hybrid  systems  are  Type  2 
computable,  such  as  polynomials,  exponentiation,  logarithm,  trigonometric  functions,  and  solution 
functions  of  Lipschitz-continuous  ordinary  differential  equations. 

More  formally,  ^  >)  represents  the  first-order  signature  over  the  reals  with  the  set 

^  of  computable  real  functions,  which  contains  all  the  functions  mentioned  above.  Note  that 
constants  are  included  as  0-ary  functions,  -formulas  are  evaluated  in  the  standard  way  over 
the  structure  >®).  It  is  not  hard  to  see  that  we  can  put  any  .ifiR^-formula  in  a 

normal  form,  such  that  its  atomic  formulas  are  of  the  form  t(xi,...,jc„)  >  0  or  t(xi,...,x„)  >  0, 
with  t(xi,  ...,jc„)  composed  of  functions  in  To  avoid  extra  preprocessing  of  formulas,  we  can 
explicitly  define  -formulas  as  follows. 

Definition  3.1  -Formulas).  Let  ^  be  a  collection  of  computable  real  functions.  We  define: 

t  :=x\  f{t),  where  f  &  ^  (constants  are  0-ary  functions) 
(p:=t>0|t>0|(pA(p|<pV(p|  3xi(p  I  Vx/(p. 

In  this  setting  -i(p  is  regarded  as  an  inductively  defined  operation  which  replaces  atomic  formulas 
t  >0  with  —t  >  0,  atomic  formulas  t  >0  with  —t  >  0,  switches  A  and  V,  and  switches  V  and  3. 

Definition  3.2  (Bounded  -Sentences).  We  define  the  bounded  quantifiers  as 

=df  3x.{u  <  X  Ax  <v  Aqt) 

=df  Vx.((m  <  X  Ax  <  v)  — )■  (p) 

where  u  and  v  denote  terms,  whose  variables  only  contain  free  variables  in  cp  excluding  x. 

A  bounded  -sentence  is  t//(xi,  ...,x„),  where  are  bounded  quanti¬ 

fiers,  and  V^(xi,  ...,x„)  is  quantifier-free. 

3.2  5 -Perturbations  and  5 -Decidability 

Definition  3.3  (5-Variants).  Let  5  G  Q+  U  {0},  and  cp  an  .^^^-formula 

<?> :  ■  ■  ■  O'fXn  Mt[ti{xJ)  >  0;tj{xj)  >  0], 

where  i  G  {1,...A:}  and  j  &  {k-\-  l,...,m}.  The  5-weakening  (p^  of  (p  is  defined  as  the  result  of 
replacing  each  atom  q  >  0  by  ti  >  —d  and  tj  >0  by  tj  >  —d: 

<P^  :  QiXi  ■  ■  ■  Q‘fXn  V[ti{xJ)  >  -5;tj{x,y)  >  -5]. 
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It  is  easy  to  see  that  the  perturbed  formula  is  implied  by  the  original  formula. 

Proposition  3.4  ((see  [10])).  For  any  (p,  we  have  (j?  — )■  (j?^. 

In  [10,  9],  we  have  proved  that  the  following  5 -decision  problem  is  decidable,  which  is  the 
basis  of  our  framework. 

Theorem  3.5  (5 -Decidability  [10]).  Let  5  G  Q’'"  be  arbitrary.  There  is  an  algorithm  which,  given 
any  bounded  .SF^^-sentence  cp,  correctly  returns  one  of  the  following  two  answers: 

•  5-True.'  (p^  is  true. 

•  False.'  (p  is  false. 

When  the  two  cases  overlap,  either  answer  is  correct. 

Theorem  3.6  (Complexity  [10]).  Let  S  be  a  class  of  .^^^-sentences,  such  that  for  any  (p  in  S,  the 
terms  in  (p  are  in  Type  2  complexity  class  C.  Then,  for  any  8  G  Q'^,  the  5 -decision  problem  for 
bounded  Ln-sentences  in  S  is  in  (51^)*“. 


4  Stability  of  Continuous  Systems 


4.1  -Representations 

Consider  an  n-dimensional  autonomous  ODE  system 


(k(t) 

dt 


(1) 


where  /  is  Lipschitz-continuous  and  x{0)  G  M”.  We  define  the  -representation  of  the  system 
to  be  a  logical  formula  that  describes  the  all  points  on  the  trajectory  of  the  dynamical  system. 


Definition  4.1.  We  say  the  system  (1)  is  ^-represented  by  an  .^^^-formula  flow(v:o,.r?,t),  if  for 
any  x{t)  G  M,  x{t)  is  on  the  trajectory  of  the  system  iff  the  flow(v:o,.rr,t)  is  true. 

From  Picard-Lindelof  iteration,  we  know  that  the  -representation  for  continuous  systems 
has  an  explicit  form: 


Proposition  4.2.  The  dynamical  system  in  (1)  has  a  trajectory  that  passes  through  a  iff  the 
following  .Sf]^^-formula  is  true: 


i\ovj{xo,xtd)  =df  {xt=  /  /(.r (5)) d5-F.ro) 

Jo 

Proposition  4.3.  A  continuous  system  has  a  Af]^^-representation,  when  f  is  a  Type  2  computable 
junction. 
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Since  /  can  be  any  numerically  computable  function,  this  definition  covers  almost  all  dynami¬ 
cal  systems  of  interest.  We  can  now  speak  of  the  dynamical  system  (1)  and  its  -representation 
^\o\N{xQ,Xt,t)  interchangeably. 

The  5-perturbation  on  a  system  is  defined  through  5-perturbations  on  its  -representation. 

Definition  4.4.  The  8 -perturbation  of  a  system  that  is  ^^^-represented  by  flow(.ro,-^rT)  is  the 
system  represented  by  \\qw°  {xQ^Xtd)- 

To  be  clear,  the  flow  formula  has  an  explicit  definition: 

Proposition  4.5.  The  8 -perturbation  of  the  system  (1)  is  represented  by 

flow^  =df  /(jc(5))d5-h.ro)|  <  S. 

Note  that  the  5 -perturbed  system  is  always  an  overapproximation  of  the  original  system: 
Proposition  4.6.  We  have  [flow]  C  |flow^]. 

4.2  Complexity  of  Lyapunov  Stability 

We  first  study  stability  in  the  sense  of  Lyapunov,  which  we  can  write  stable  i.s.L.  Following  stan¬ 
dard  definition,  a  system  is  stable  i.s.L.  if  given  any  e,  there  exists  5  such  that  for  any  initial  value 
xq  that  is  within  5  from  the  origin,  the  system  stays  in  e-distance  from  the  origin.  The 
representation  of  stability  in  the  sense  of  Lyapunov  is  naturally  the  following  formula. 

Definition  4.7  (L_Stable).  We  encode  conditions  for  Lyapunov  stability  with  the  formula  L_Stable 
as  follows. 


V[o,°°)£g[o,e]5v[o,°°)^Y_^pY_^^_  (II^qII  <  8  /\Xt  =  [  f{s)ds-\-xo)  — )■  ||.rf||  <  e. 

Jo 

The  bounded  form  o/L_Stable  is  defined  by  bounding  the  quantifiers  in  the  formula  as  follows: 

(||.ro||  <  5  A jc,  =  t  f{s)ds  +  xo)  ^  ||;c,||  <  e, 

Jo 


where  e,T  E  and  X  is  a  compact  set. 

It  is  not  hard  to  see  that  the  formula  encodes  the  definition  of  stability  in  the  sense  of  Lyapunov. 

Proposition  4.8.  The  origin  is  a  stable  equilibrium  point  ij^L.Stable  is  true. 

We  can  now  define  the  5-stability  problem  using  the  -representation. 

Definition  4.9  (5-Stability  i.s.L.).  The  8-stability  problem  i.s.L.  asks  for  one  of  the  following  an¬ 
swers: 
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•  stable;  The  system  is  stable  i.s.L.  (L.Stable  is  true). 

•  5-unstable;  Some  5 -perturbation  o/L_Stable  is  false. 

We  defined  the  bounded  5 -stability  problem  by  replacing  L_Stable  with  the  bounded  form  of 
L  stable  in  the  definition. 

Now,  using  the  complexity  of  the  formulas,  we  have  the  following  complexity  results  for  the 
bounded  version  of  Lyapunov  stability. 

Theorem  4.10  (Complexity).  Suppose  all  terms  in  the  .^^^-representation  of  a  system  are  in 
Type  2  complexity  class  C.  Then  the  bounded  8 -stability  problem  i.s.L.  resides  in  complexity  class 

Proof.  The  .i^K^-formula  L.Stable  is  a  formula.  By  Definition  5.11,  the  5-stability  problem 
is  equivalent  to  the  5-decision  problem  of  the  formula  L  Stable.  Following  Theorem  3.6,  we 
have  that  the  complexity  of  the  5-decision  problem  for  the  bounded  form  of  L  Stable  is  in  (Fig  )^. 
Consequently,  the  bounded  5-stability  problem  i.s.L.  resides  in  (Fig  )*“.  □ 

Following  the  complexity  for  Lipschitz-continuous  ODEs,  we  have  an  upper  bound  for  the 
complexity  of  a  wide  range  of  systems. 

Corollary  4.11.  Suppose  that  in  the  system  (1),  f  is  a  Type  2  polynomial-time  computable  function. 
Then  the  bounded  5-stability  problem  i.s.L.  is  in  PSPACE. 

Proof.  The  -representation  flow  can  be  evaluated  in  PSAPCE.  Since  (FI3  C  PSPACE, 

we  know  that  the  problem  resides  in  PSPACE.  □ 

We  have  mentioned  that  most  of  common  functions  and  their  compositions  are  polynomial¬ 
time  computable:  polynomials,  trigonometric  functions,  exponential  functions,  etc.  Consequently, 
for  most  nonlinear  continuous  systems  of  practical  interest,  the  stability  problem  is  in  PSPACE. 

The  unbounded  case  involves  testing  the  bounded  formula  for  longer  and  longer  time  durations. 
Thus,  it  is  still  undecidable.  We  can  obtain  the  degree  of  undecidability  of  the  unbounded  case  from 
the  logical  encoding. 

Theorem  4.12.  The  unbounded  Lyapunov  5 -stability  problem  is  in  Tf®. 

Proof.  We  compute  5-decisions  of  the  bounded  form  of  the  formula  L.Stable  for  increasingly 
larger  time  bound  T .  If  for  any  T  the  formula  is  5 -false,  then  the  system  is  5 -unstable.  On  the 
other  hand,  we  will  not  be  able  to  confirm  that  the  system  is  stable  as  T  approaches  infinity.  Thus, 
the  problem  is  in  11®  of  the  arithmetic  hierarchy.  □ 
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4.3  Complexity  of  Asymptotic  Stability 

Following  standard  terminology,  we  say  a  system  is  asymptotically  stable  if  it  is  Lyapunov  sta¬ 
ble,  and  there  exists  some  bound  on  the  perturbation  in  the  initial  state  such  that  the  system  will 
converge  to  the  origin  eventually.  We  now  study  the  complexity  of  this  problem. 

First,  since  asymptotic  stability  involves  properties  of  the  system  at  the  limit,  we  need  to  be 
express  that  as  an  -formula,  as  follows. 

Definition  4.13.  Wfe  define  the  following  formula  for  lim;c^oo(/(v),  c) 

lim(/(;c),c)  =df  (\f(x)-c\  <  e). 

We  can  use  the  conventional  notation  lim;c->oo/(v)  =  c.  Also,  for  convergence  at  a  point  a  G  M”'", 
we  define 

lim(/(.r),c)  =df  (l/W-cl  <  e). 

Note  that  here  the  quantification  on  e  and  d  can  be  easily  bounded,  since  we  do  not  need  to 
consider  e  and  d  that  are  very  large.  Although  further  parameterization  on  the  bounds  are  needed, 
for  notational  simplicity  we  simply  treat  this  formula  as  a  bounded  -formula. 

Now,  asymptotic  stability  is  defined  as: 

Definition  4.14  (A_Stable).  We  define  A_Stable  to  be  the  following  -formula 

V[®’‘^)e3[0’^]5V[®’°o)tVjcoVv,(^(||.ro||  <5  Axt  =  f{s)ds  +  xf)  -)■  ||vf||  <  ej 

A3[0’°o)5V[0’°°)tV.roVv,f(||jco||  <  5'  Axt=  f  f{s)ds  -\-xo)  — )■  lim||v:r||  =  oV 

V  Jo  ) 

The  bounded  form  o/A_Stable  is  defined  as: 

vMeg[OAl5v[°’^]tV^v:oV^Vf(^(||vo||  <d  Axt  =  f{s)ds+xo)  -)■  ||vf||  <  e'j 

A3[0’'^]5V[®’^  f  (I  |vo|  I  <  5'  Axt  =  [  f{s)ds  -\-xo)  -A  lim  ||v:;||  =  o) 

V  Jo  / 

where  e,T,T' ,d  G  and X  is  a  compact  set. 

Proposition  4.15.  The  origin  is  asymptotically  stable  for  a  system  iff  the  formula  A.Stable  is  true. 

We  can  now  define  the  5-stability  problem  using  the  -representation. 

Definition  4.16  (Asymptotic  5-Stability).  The  d-stability  problem  i.s.A.  asks  for  one  of  the  follow¬ 
ing  answers: 

•  Stable.'  The  system  is  stable  i.s.A.  (A.Stable  is  true). 

•  5-unstable.'  Some  5 -perturbation  o/ A  Stable  is  false. 
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Wfe  defined  the  bounded  8-stability  problem  by  replacing  A.Stable  with  the  bounded  form  of 
A.stable  in  the  definition. 

We  can  now  obtain  complexity  results  for  the  problem. 

Theorem  4.17.  Suppose  all  terms  in  the  Jfis.^-representation  of  a  system  are  in  Type  2  complexity 
class  C.  Then  bounded  asymptotic  5 -stability  is  in  (Z4)  . 

Proof  The  complexity  of  the  formula  is  higher  than  the  one  encoding  Lyapunov  stability,  because 
of  the  quantification  structure  in  the  encoding  of  the  limit.  After  rearranging  the  formula,  we  have 

^  ^  f{s)ds  +  Xq)  ^  ||.rf||  <  c) 

A  <5' ^xt=  l^f{s)ds  +  xo)  ^  ||;q||  <  e' 

This  is  a  E4-formula.  Following  Theorem  3.6  we  know  that  the  problem  resides  in  (Z4 )  .  □ 

The  degree  of  undecidability  for  the  unbounded  version  is,  however,  different  from  Lyapunov 
stability.  This  is  because  we  need  to  find  the  bound  of  perturbation  that  ensures  the  convergence  to 
the  origin. 

Corollary  4.18.  Unbounded  asymptotic  5 -stability  is  in 

Proof  In  the  formula  A  Stable,  we  need  to  incrementally  search  for  a  value  for  5' .  Each  of  the 
value  corresponds  to  an  unbounded  search  for  the  time  bound,  which  is  similar  to  the  case  of 
Lyapunov  complexity.  Thus,  we  need  to  solve  unbounded  3V  quantification,  which  means  the 
unbounded  problem  is  in  E®  of  the  arithmetic  hierarchy.  □ 

It  is  probably  interesting  to  note  that  the  problem  P  7^  N  P  has  the  same  degree  of  undecidability. 

There  is  also  the  notion  of  “asymptotic  stability  in  the  large,”  which  ensures  that  for  any  per¬ 
turbation  on  .r(O),  the  system  will  stabilize.  The  quantification  turns  out  to  be  slightly  different: 

Proposition  4.19  (Asymptotic  Stability  in  the  Large).  The  origin  is  an  asymptotically  stable  equi¬ 
librium  point  iff  the  following  -formula  is  true 

V[®’‘^)e3[0’^]5V[®’°°)tVjcoV.r,(^(||vo||  <  5  A.r,  =  ^  f{s)ds  +  xo)  -)■  ||jCf||  <  ej 

AVt®’°°^5Vf®’°°VVvoV.r;f(||jco||  <  5'  /\Xt=  [  f(s)ds  -\-xo)  — )■  limlljcdl  =0). 

V  Jo  / 

Computationally,  this  is  in  fact  a  simpler  task  than  asymptotic  stability.  We  state  the  following 
result  without  duplicating  the  proofs. 

Theorem  4.20.  Suppose  all  terms  in  the  .Sfig^^-representation  of  a  system  are  in  Type  2  complexity 
class  C.  Then  bounded  asymptotic  5-stability  in  the  large  is  in  (fig  )*“.  The  unbounded  case  resides 
in  n^. 
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4.4  Complexity  of  Lyapunov  Methods 

We  show  that  Lyapunov  methods  reduee  the  eomplexity  of  stability  problems.  We  only  diseuss  the 
first-order  eneodings  of  the  problems,  in  whieh  a  Lyapunov  function  is  considered  with  a  template 
function  with  unspecified  parameters. 

Proposition  4.21.  Consider  the  dynamical  system  (1).  Let  V  {p,x)  be  a  function,  parameterized  by 
p,  whose  partial  derivative  dV  /  dx  is  a  Type  2  computable  function.  Let  D  be  the  parameter  space 
for  p  and  X  be  the  state  space  ofx.  We  then  have 

•  The  following  -formula  is  a  sufficient  condition  for  stability  in  the  sense  of  Lyapunov 

dip^M^x  (vip,Q)  =  0  A  (v:  7^  0  — )■  V(p,x)  >  0)  A  <  0 

\  dx 

•  The  following  is  a  sufficient  condition  for  asymptotic  stability: 

3p^\/^x  ^y(p,0)  =  0  A  (v:  7^  0  — )■  V{p,x)  >  0)  A  =  0  — )■  f{x)  =  0^  A  ^.r  7^  0  — )■  f{x) 

Definition  4.22  (5-Complete  Lyapunov  Test).  Let  V{p,x)  be  a  proposed  template  for  Lyapunov 
function.  The  8 -complete  Lyapunov  test  asks  for  one  of  the  following  answers: 

•  Success.'  There  exists  an  assignment  to  p  such  that  the  Lyapunov  function  witness  stability 
of  the  system. 

•  5-Fail.'  The  Lyapunov  conditions  fail  under  8 -perturbations  for  all  possible  parameteriza- 
tions  ofV  {p,x)  in  the  parameter  space  D. 

Theorem  4.23.  Suppose  all  terms  in  the  .^^^-representation  of  the  Lyapunov  conditions  are  in 
Type  2  complexity  class  C.  The  complexity  of  bounded  8-complete  Lyapunov  methods  is  in  )*“. 

It  is  clear  that  for  the  fully  unbounded  case  (where  both  D  and  X  are  unbounded),  undecidability 
comes  from  the  search  in  larger  and  larger  parameter  and  state  space. 

Corollary  4.24.  The  unbounded  8-complete  Lyapunov  test  for  an  unbounded  system  is  in 

5  Stability  of  Hybrid  Systems 

An  important  benefit  of  using  logic  formulas  for  describing  systems  is  that  discrete  changes  can 
be  naturally  represented.  Although  the  discrete  components  significantly  complicates  the 
representations  of  the  problems,  they  do  not  change  the  quantification  structure  of  the  encodings. 

Thus,  we  will  see  that  the  complexity  upper  bound  of  the  continuous  systems  mostly  carry  over 
to  the  case  of  hybrid  systems  as  well.  On  the  other  hand,  it  is  indeed  easier  to  show  hardness 
results  (lower-bound)  using  logical  operations,  and  in  this  sense  hybrid  systems  are  intrinsically 
more  complicated  than  continuous  systems. 
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5.1  -Representations  of  Hybrid  Systems 

We  first  show  that  -formulas  can  concisely  represent  hybrid  automata. 

Definition  5.1.  A  hybrid  automaton  in  ^-representation  is  a  tuple 

H  =  (X,  2,  {flow^(^,y,  t):qe  2},  {inv^(f)  :qeQ},  {jump^^^,(f,y)  :q,q  e  2},  {init^(f)  :qeQ}) 

where  X  C  for  some  n  eN,  Q  =  {qi,  ...,qm}  is  a  finite  set  of  modes,  and  the  other  components 
are  finite  sets  of  quantifier-free  -formulas. 

Notation  5.2.  For  any  hybrid  system  H,  we  write  X(//),  flow(//),  etc.  to  denote  its  corresponding 
components. 

Almost  all  hybrid  systems  studied  in  the  existing  literature  can  be  defined  by  restricting  the  set 
of  functions  ^  in  the  signature.  For  instance, 

Example  5.3  (Linear  and  Polynomial  Hybrid  Automata).  Let  =  {-I-}  UQ  and  =  |  x  }  u 
Rational  numbers  are  considered  as  0-ary  functions.  In  existing  literature,  H  is  a  linear 
hybrid  automaton  if  it  has  an  -representation,  and  a  polynomial  hybrid  automaton  if  it  has 

an  -representation. 

Example  5.4  (Nonlinear  Bouncing  Ball).  The  bouncing  ball  is  a  standard  hybrid  system  model. 
Its  nonlinear  version  (with  air  drag)  can  be  -represented  as  follows: 

•  X  =  and  Q  =  {qu^qd}-  We  use  qu  to  represent  bounce-back  mode  and  q^  the  falling 
mode. 

•  flow  =  {i\o\NqfixQ,VQ,Xt,Vt,t)fi\o\NqfixQ,VQ,Xt,Vtd)}.  Wc  usc  jc  to  dcnotc  the  height  of  the 
ball  and  v  its  velocity.  Instead  of  using  time  derivatives,  we  can  directly  write  the  flows  as 
integrals  over  time,  using  -formulas: 

-  flow^^(vo,  vo,x,,Vf,t)  defines  the  dynamics  in  the  bounce-back  phase: 

{xt=xo+  f  v{s)ds)A{vt=vo+  [  g{l  -  I5v{s)^)ds) 

.Jo  Jo 

-  i\o\Nqj{xo,vo,Xt,Vtd)  defines  the  dynamics  in  the  falling  phase: 

{xt=xo+  f  v{s)ds)A{vt=vo+  f  g{l -A I5v{s)^)ds) 

Jo  Jo 

where  j8  is  a  constant.  Again,  note  that  the  integration  terms  define  Type  2  computable 
functions. 

•  jump  =  {jump^_^_,^^(v,v,v',v')Jump^^_,^_^(v,v,y,v')}  where 

-  jump^^_,^^(v,v,v',v')  is  (v  =  0Av'  =  vAv'  =  v). 
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-  j  u  m  (;c,  V,  y ,  v' )  is  (;c  =  0  A  v'  =  av  A  y  =  ;c) ,  for  some  constant  a . 

•  init^^  :  (;c  =  10  A  V  =  0)  and  init^^  :  ±. 

•  inv^^  :  [x  >=  0  A  v  >=  0)  and  inv^^  :  {x  >=  0  A  v  <=  0). 

Trajectories  of  hybrid  systems  combine  continuous  flows  and  discrete  jumps.  This  motivates 
the  use  of  a  hybrid  time  domain,  with  which  we  can  keep  track  of  both  the  discrete  changes  and 
the  duration  of  each  continuous  flow.  A  hybrid  time  domain  is  a  sequence  of  closed  intervals  on 
the  real  line,  and  a  hybrid  trajectory  is  a  mapping  from  the  time  domain  to  the  Euclidean  space. 

We  now  define  5 -perturbations  on  hybrid  automata  directly  through  perturbations  on  the  logic 
formulas  in  their  -representations.  For  any  set  S  of  -formulas,  we  write  to  denote  the 
set  containing  the  5 -perturbations  of  all  elements  of  S. 

Definition  5.5  (5-Weakening  of  Hybrid  Automata).  Let  5  G  Q+  U  {0}  be  arbitrary.  Suppose 

H  =  (A,  2,  flow, jump,  inv,  init) 

is  an  .^^^-representation  of  hybrid  system  H.  The  5-weakening  ofH  is 

=  (A,2,flow^,jump^,inv^,init^) 

which  is  obtained  by  weakening  all  formulas  in  the  .^^^-representations  ofH. 

Example  5.6.  The  5 -weakening  of  the  bouncing  ball  automaton  is  obtained  by  weakening  the 
formulas  in  its  description.  For  instance,  flow"^(v:o,vo,.rf,  v,,t)  is 

\xt-{xQ+  j  v{s)ds)\ <  5  A\vt -{vo+  [  g{l  -  j5v{s)'^)ds))\ <  5 
Jo  Jo 

andjumpj^_,^_^(.r,v,y,v')  is 

|jc|  <  5  A  \v  —  av\  <  5  A  |y  —  .r|  <  5. 

It  is  important  to  note  that  the  notion  of  5-perturbations  is  a  purely  syntactic  one,  defined  on  the 
description  of  hybrid  systems.  Following  Proposition  3.4,  it  can  be  easily  seen  that  the  syntactic 
perturbations  correspond  to  semantic  over- approximation  of  H  in  the  trajectory  space. 

5.2  Complexity  of  Stability 

We  now  obtain  complexity  results  for  stability  of  hybrid  systems.  The  main  difference  from  the 
continuous  systems  is  that  the  set  of  reachable  states  of  a  hybrid  system  requires  a  more  complex 
encoding.  However,  we  will  see  that  they  do  not  change  the  upper  bound  of  the  complexity,  since 
the  quantification  structure  does  not  change. 

First,  we  need  to  define  a  set  of  auxiliary  formulas  that  will  be  important  for  ensuring  that  a 
particular  mode  is  picked  at  a  certain  step. 
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Definition  5.7.  Let  Q  =  be  a  set  of  modes.  For  any  q  EQ,  and  i  G  N,  use  b‘^  to  represent 

a  Boolean  variable.  We  now  define 

enforceg(^,/)  /\ 

p<^Q\{q} 

en^orceQ{q,qfi)=b'qF^b'^^F  /\  ^b‘p  A  /\ 

peQ\{q}  p'eQ\{q'} 

We  omit  the  subscript  Q  when  the  context  is  clear. 

Definition  5.8  (A:-Step  Reachable  Set).  Suppose  H  is  invariant-free,  and  U  a  subset  of  its  state 
space  represented  by  unsafe.  The  .Sf^^-formula  ReachH,uik,M)  is  defined  as: 

\l  ^init^(fo)  Aflow^(fo,.^,to)  A  enforce(<5r,0)  A  {i\o\Nq{xo,xd)  -A  inv^(^))j 

q<^Q 

k-i  / 

i=0  ^q,q'eQ 

Aenforce{q,q' fi)  Aenforce{q\i+  1) 

Proposition  5.9  (Hybrid  Lyapunov  Stability).  The  origin  is  a  stable  equilibrium  point  if 
V[0,°°)£g[0,e]^V[®’°°VV.roV.r?(||.ro||  <  5  A  Reach(v:o,JCr,t))  — )■  ||.rf||  <  £■ 

Proposition  5.10  (Asymptotic  Stability).  The  origin  is  an  asymptotically  stable  equilibrium  point 

if 

V[oH£g[OAl5V[®’°°)tV.roV.rf  ^(||.ro||  <  5  A  Reach(v:o,.rf,t))  — )■  |  |.rf  1 1  <  e j 
A3[®’°°)5V[®’°°)tVjcoV.rA(lko||  <  5' A  Reach(v:o,JC;,t))  -)■  lim  \  \xt\  \  =  oV 

V  t~^oo  / 

The  definition  is  5-stability  is  the  same  as  in  the  continuous  case. 

Definition  5.11  (5-Stability).  The  (Lyapunov  or  asymptotic)  5-stability  problem  of  hybrid  systems 
asks  for  one  of  the  following  answers: 

•  Stable.'  The  system  is  stable. 

•  5-unstable.'  Some  5 -perturbation  of  the  Jf^^-representation  of  stability  is  false. 

Theorem  5.12.  Suppose  all  terms  in  the  .^^^-representation  of  stability  are  in  Type  2  complexity 
class  C.  We  have 

•  The  bounded  Lyapunov  5-stability  problem  of  hybrid  systems  is  in  (flg)*^.  The  asymptotic 
5 -stability  of  hybrid  systems  is  in  complexity  class  (5I4  )*“. 
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•  The  unbounded  d -stability  problem  of  hybrid  systems  is  in  FI  5  and  asymptotic  d -stability  is 
in  Z®. 

From  these  results,  it  may  seem  that  hybrid  systems  are  not  harder  than  eontinuous  systems, 
in  terms  of  the  upper  bounds  on  eomplexity.  However,  the  diserete  eomponents  of  hybrid  systems 
make  it  mueh  easier  to  reaeh  a  high  lower  bound  on  the  eomplexity.  For  instanee,  it  is  easy  to  show 
that  the  eomplexity  results  are  tight  in  the  following  sense: 

Theorem  5.13.  Suppose  the  terms  in  describing  the  stability  formulas  are  polynomial-time  Type  2 
computable.  The  bounded  Lyapunov  and  asymptotic  5 -stability  of  hybrid  systems  are  both  (Fig  )- 
complete. 

The  reason  is  that  logie  formulas  ean  be  easily  eneoded  as  jumping  eonditions  of  hybrid  sys¬ 
tems.  It  is  then  straightforward  to  reduce  complete  problems  in  the  complexity  class  to  stability 
problems  of  hybrid  systems.  We  omit  the  full  proof  here. 

6  Conclusion  and  Future  Work 

We  defined  a  framework  for  measuring  the  “practical  complexity”  of  stability  problems  for  a  wide 
range  of  nonlinear  continuous  and  hybrid  systems.  To  do  so,  we  describe  stability  properties  of 
systems  as  first-order  formulas  over  the  real  numbers,  and  reduce  stability  problems  to  the  5- 
decision  problems  of  these  formulas.  The  framework  allows  us  to  obtain  a  precise  characterization 
of  the  complexity  of  different  notions  of  stability  that  has  not  been  discovered  previously.  We  prove 
that  bounded  version  of  the  stability  problems  are  generally  decidable,  and  give  precise  measure 
of  the  upper  bound  of  their  complexity.  The  unbounded  versions  are  generally  undecidable,  for 
which  we  give  precise  measures  of  their  degrees  of  undecidability. 

We  believe  the  results  serve  as  a  basis  for  developing  computational  methods  towards  nonlinear 
and  hybrid  control  techniques.  An  immediate  next  step  is  to  use  these  methods  to  study  other  prob¬ 
lems  such  as  controllability  and  observability  of  nonlinear  systems.  On  the  other  hand,  the  logical 
descriptions  of  the  problems  can  directly  guide  the  development  of  practical  decision  procedures 
for  the  problems. 
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